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This paper reviews the fully complete hypergames model of system F, presented a decade ago 
in the author's thesis. Instantiating type variables is modelled by allowing "games as moves". 
The uniformity of a quantified type variable VX is modelled by copycat expansion: X represents 
an unkown game, a kind of black box, so all the player can do is copy moves between a positive 
occurrence and a negative occurrence of X. 

This presentation is based on slides for a talk entitled "Hypergame semantics: ten years later" 
given at Games for Logic and Programming Languages, Seattle, August 2006. 

1 Introduction 



Zwicker's Hypergame llZwi87ll is an alternating two-player game: one player chooses any alternating 
game G which terminatefl {e.g. "O's & X's" or Ches^, then play proceeds in gH 
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*Visiting scholar, Computer Science Department, Stanford University, CA 94305. 
^Every legal sequence of moves is finite. 

^To ensure termination, assume a draw is forced upon a threefold repetition of a position (a variant of a standard rule). 

^The question "Does Hypergame terminate?", the Hypergame paradox, amounts to a hereditary form of Russell's paradox, 
known as Mirimanoff's paradox |Mirl71: "Is the set of well-founded sets well-founded?". (Each 'paradox' is illusory, being 
merely due to the lack of formal definition of "game" or "set".) 
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At the Imperial College Games Workshop in 1996, the author illustrated how hypergames — games 
in which games can be played as moves — can model languages with universal quantification. 
Originally implemented in [ ,Hug97J for Girard's system F [iGir71[ [GLT89I1 . the idea is quite gen- 
eral, and has been successfully applied to affine linear logic HMOOll IMurOlU and Curry-style type 
isomorphisms idL06i . 

1.1 Universally quantified games 

Recall the little girl Anna-Louise who wins one point out of two in a "simultaneous display" against 
chess world champions Spassky and Fischer [ fCon76[ Theorem 51]. She faces Spassky as Black and 
Fischer as White, and copies moves back and forth, indirectly playing one champion against the 
other. When Spassky opens with the Queen's pawn d4, she opens d4 against Fischer; when Fischer 
responds with the King's knight ^{6, she responds against Spassky, and so on. 
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We shall write G ^ G for such a simultaneous display with a game G (so Anna-Louise played the 
game Chess — > Chess above, as second player, against the Fischer-Spassky team) 

Observing that her copycat strategy is not specific to chess, Anna-Louise declares that she will 
tackle the Fischer-Spassky team in a more grandiose spectacle: she will give them an additional first 
move, to decide the game for simultaneous display. For example, the Fischer-Spassky team might 
choose Chess, thereby opting for the simultaneous display Chess Chess, and play continues as 
above. Or they might choose O's & X's, opting for the simultaneous display O's & X's O's & X's, and 
open with X in the centre of Spassky's grid; Anna-Louise copies that X accross as her opening move 
on Fischer's grid; Fischer responds with O in (his) top-left; Anna copies this O back to Spassky; and 
so on: 



'^Conway writes — G + G, orG — G iCon76i Chapter?]. Later on, we shall add a form of backtracking to our games 
so that Anna-Louise may restart the game with Fischer as many times as she likes, corresponding to the intuitionism of the 
arrow of system F, in which a function may read its argument any number of times |Lor60 Fel85 Coq91 HO00|. To 
maintain the focus on universal quantification, here in the introduction we shall ignore the availability backtracking. 
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Fischer Spassky 
O 




O top-left 
Anna-Louise 

The key novelty of [|Hug97P was to define this as a formal game, a hypergame or universally quanti- 



fied game, which we shall write as 

VG . G ^ G 

The tree of VG . G ^ G is illustrated below. Similar in spirit to Zwicker's hypergam^E it differs in 
the fact that the first player not only chooses G but also plays an opening move ra in G. We call 
such a compound move (importing a game, and playing a move in a game) a hypermove. 
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1.2 Self-reference (without paradox) 

In the tree above, we have shown two cases for instantiating G in the hypergame H — VG . G ^ G, 
either to Chess or to O's & X's. But it is also possible to instantiate G to a hypergame, or indeed, to 
H itself. We consider this case below. The initial state is: 

^The author was unaware of Zwicker's work while preparing (Hug97( , hence the lack of reference to Zwicker in that 
paper, and in the author's thesis ^HugOOJ . 
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Fischer Spassky 
VG . G ^ G 
Anna-Louise 

Fischer and Spassky begin by importing a game for G, in this case, H = VG . G ^ G itself, yielding 
a simultaneous display of H: 

Fischer Spassky 
H ^ H 
Anna-Louise 

In other words, we have: 



Fischer 

VGi . Gi ^ Gi 



Spassky 
VG2 . G2 ^ G2 



Anna-Louise 



The local bound variable G is renamed in each component to clarify the evolution of the game 
below0 As in the simultaneous display Chess Chess, where Spassky opened with a move on his 
chessboard, here in H ^ H Spassky must complete the opening hypermove by playing a move on 
his copy of H. Since H — VG2 . G2 ^ G2 is a hypergame, opening H requires importing another 
game, instantiating G2. Suppose he chooses Chess for G2: 
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^The scope of VGi in the diagram does not extend past the central arrow 
by Anna-Louise is (VGi.Gi ^ Gi] ^ (VG2.G2 G2). 



In other words, formally the game played 
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Now Spassky has his own local simultaneous display Chess — > Chess. To complete his opening (hy- 
per) move on the overall game, he must open this chess display. Suppose he plays 5^f3 (necessarily 
on the right board, where it is his turn since he has White) : 
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Now it is Anna-Louise's turn. She has three options: (1) respond to Spassky as Black on the 
rightmost chess board, (2) respond to Spassky as White on the other chess board, or (3) play an 
opening move against Fischer in VGi . Gi Gi. We consider the last case, since it is the most 
interesting. Suppose Anna-Louise chooses to import O's & X's for Gi: 
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Now Fischer has his own local simultaneous display O's & X's —> O's & X's. For Anna-Louise to 
complete her hypermove, she must play a move on O's & X's O's & X's (necessarily in the right of 
the two grids, the one in which it her turn). Suppose she plays her X top-right: 
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Fischer responds either with an O in the same grid, or with an X in the empty grid, and play continu- 
ous in the two local simultaneous displays, O's & X's — > O's & X's against Fischer and Chess — > Chess 
against Spassky. 

But to remain consistent with her copycat strategy, Anna-Louise must mimic Spassky. Instead of 
importing O's & X's for Gi against Fischer, she must import Chess and open with the White move 
^f3, exactly as Spassky did: 
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Chess , 4^f3 



Anna-Louise 



Fischer might now open his other board with e4, which Anna-Louise would copy back to the corre- 
sponding board against Spassky: 
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Or perhaps Fischer responds with Black in the rightmost of his pair of boards, with d5, which 
Anna-Louise copies to Spassky: 
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Either way, she continues to copy moves between the four boards according to the following geom- 
etry of copycat links: 
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This copycat strategy corresponds to the polymorphic identity system F term 

AG.Ag^.g 

of type VG.G ^ G. 



1.3 Uniformity 

Consider again the original Fischer-Spassky simultaneous display, with chess. Add Kasparov to the 
team, playing Black. 
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Anna-Louise has two distinct ways to guarantee picking up a point. Either she copies moves between 
Spassky and Fischer, as before, while ignoring Kasparov (never playing a move against him). 
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or she copies moves between Spassky and Kasparov, ignoring Fischer: 
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We shall write this triple simultaneous display as Chess Chess Chess, and more generally, 
for any game G, as G — > G ^ G0 

Now consider the universally quantified form of this game, the hypergame 

VG.G ^ G ^ G. 

As with VG . G ^ G discussed above, the Kasparov-Fischer-Spassky team, KFS, now has the right to 
choose the game of the triple simultaneous display, as part of their opening (hyper)move. We shall 
say that Anna-Louise's strategy is uniform in this setting if 

• irrespective of the game chosen by KFS, she always ignores the same player, Kasparov or 
Fischer. 

Otherwise her strategy is ad hoc. For example, her strategy would be ad hoc if, when KFS chooses 
Chess, she ignores Kasparov and copies chess moves between Fischer and Spassky, but when KFS 
chooses O's & X's, she ignores Fischer and copies X and O moves between Kasparov and Spassky. 
In this case the geometry of her move copying depends on the game imported by FKS: she is not 
treating G as a "black box". 

There are only two uniform strategies for Anna-Louise: either she always copies between Kas- 
parov and Spassky, ignoring Fischer, or she always copies between Fischer and Spassky, ignoring 
Kasparov. These correspond to the system F terms 

AG . Ak^ . Af ^ . k 
AG . Ak'^ . Af ^ . f 

respectively, of type 

VG . G ^ G ^ G , 

where the variable k corresponds to Kasparov and f corresponds to Fischer. 

More generally, with multiple bound V variables and more complicated game imports, we shall 
take uniformity to mean that the links Anna-Louise sets up between components (such as the 
Kasparov ^ Spassky or Fischer ^ Spassky links above) must be independent of the games imported 
by the opposing team: these imported games are impenetrable "black boxes". 

^Again with the backtracking caveat: see footnote|4] 
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Fixed links. Uniformity as independence from the particular games imported by the opposing 
team will include independence from the not only the identity of those games, but also from their 
state. This will ensure that the geometry of Anna-Louise's copycat play remains constant over time: 
once she has committed to linking one component to another, she must stick with that link for 
the rest of the hj^ergame. To illustrate this aspect of uniformity, consider the quadruple chess 
simultaneous display with Kasparov and Fischer playing Black, and Karpov and Spassky playing 
White: 
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We shall write Chess x Chess Chess x Chess for this simultaneous display!^ Suppose Spassky 
begins with e4. Anna-Louise, playing copycat, has a choice between copying this move to Fischer 
or to Kasparov. Suppose she copies it to Fischer, who responds with c5, which she duly copies back 
to Spassky: 
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Suppose Karpov opens his game with the very same move as Spassky, e4, which Anna-Louise copies 
accross to Kasparov (the only destination where this move makes sense) : 

^With the backtracking caveat: see footnote|4] 
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Kasparov responds with the same move as Fischer, c5, which Anna-Louise copies back to Karpov: 
Kasparov Fischer Karpov Spassky 
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So far, Anna-Louise has Unked Spassky with Fischer, and Karpov with Kasparov: 
Kasparov Fischer Karpov Spassky 
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By (contrived) coincidence, both pairs of linked boards happen to have reached exactly the same 
state. Therefore from this point onwards, Anna-Louise could change the linkage, linking Kasparov 
with Spassky, and Karpov with Fischer: 
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For example, should Karpov respond with "S^fS, she would copy that move across to Fischer, then 
continue copying between Fischer and Karpov, and between Kasparov and Spassky. 

She could do this "relinking" for any game G, not just Chess, onGxG GxG:no matter 
what the game G is, she could link the first and third G, and link the second and fourth G, but if a 
point is reached in which all four copies of G have the same state, she switches the linkage, as in 
the chess example above. If she consistently does this for all G, she has a strategy on the hypergame 
VG . G X G —> G X G which, in some fashion, does not depend on G . Such "relinking" strategies do 
not correspond to system F terms, and are eliminated from the model by our uniformity condition: 
independence from G means independence not only from the identity of G, but also from the state 
of G. 



1.4 Negative quantifiers 

Linear polymorphism was modelled in ||Abr97ll using a universal notion of the games in ||AJ94[ 
lAJMOO'l . Full completeness failed for types with negative quantifiers. In this subsection we illustrate 
how the hypergames model successfully treats negative quantifiers. 

The polarity of a quantifier in a type is positive or negative according to the number of times it 
is to the left of an arrow (in the syntactic parse tree of the type): positive if even, negative if odd. 
For example, VX is positive in VX.T and VY.VX.T, negative in (VX.U] ^ T and (V -> VX.U) ^ T, 
and positive in ((VX.U) ^ V) ^ T. 

Consider the simultaneous display H ^ H where H is the h5^ergame VG . G ^ G : 
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Anna-Louise 

Fischer's quantifier VGi is negative|f| To kick off, Spassky must open the game VG2 . G2 ^ G2 in 
front of him. This is a hj^ergame, universally quantified, so he must begin by instantiating G2. He 
chooses G2 — Chess, and opens "SifS on the board where he has White: 
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We shall consider three of the copycat strategies available to Anna-Louise from this point: 



Strategy 


Anna Louise. . . 


Corresponding term of type H — > H 


L 


. . . copies what Spassky did accross to 
Fischer: import Chess and play €^f3 




cr 


. . . plays copycat in Spassky's local chess 
display, "playing Spassky against himself" 


Ah^^.AG.Ag'^.g 


T 


. . . imports Gi = Chess Chess against 
Fischer, then copies moves between the six 
resulting boards, along three "copycat links" 


Ah^^.AG.Ag'^.KG^GlAxG.xJg 



The notation hu in the third term denotes the application of h to the type U. 



The first copycat strategy l . Anna-Louise opens the hypergame VGi . Gi Gi in front of Fischer 
by mimicking Spassky: she imports Chess for Gi and opens with ^f3 as White: 

'The scope of VGi in the diagram does not extend past the central arrow — >. 
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She then copies moves between the four boards according to the following geometry of copycat 
links: 
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This copycat strategy l corresponds to the identity system F term 

of type H — > H. (Recall H = VG . G ^ G.) The same strategy models the tj-expanded variant 
AH^.AG.AgG.hcg. 



The second copycat strategy cr . The second copycat strategy cr "plays Spassky against himself". 
Recall the state after Spassky's opening move: 
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Spassky has just imported Chess and opened with the White move ^f3. In this scenario Anna- 
Louise copies that move locally, to the other board in front of Spassky: 
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Spassky may respond with g6 as Black, which Anna-Louise copies back to the other board: 
Fischer Spassky 
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She continues to copy moves along the following copycat link, leaving Fischer to forever twiddle 
his thumbs: 
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This copycat strategy corresponds to the system F term 

AK^.AG.Ag'^.g 

of type H ^ H. (Recall H = VG . G ^ G .) Fischer's eternal thumb twiddling corresponds to h not 
showing up in the body of the term. 

The third copycat strategy t . The third copycat strategy t, like the first, the identity l, responds 
to Fischer. However, instead of importing Chess for Gi against Fischer, as in l, Anna-Louise imports 
a simultaneous chess display Chess — > Chess for Gi Pi 



Fischer 



Spassky 



flSflAflaaa 



a a fl fl 4 fl fi , 






A 








a 


H 


i 1 




1 1 1 i * 




A A A A A A 


A 


A 










a 








fl 


fl fl fl fl A 






1 


* 














I 



Anna-Louise 



As shown above, Anna-Louise copies Spassky's ^f3 onto the fourth board against Fischer. She 
continues with the following geometry of copycat links: 

^"As usual, the large arrow — ^ between Fischer and Spassky binds most strongly (so we can omit brackets around the 
left four boards) . 
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On the right four boards she continues just as on the four boards of the identity l. If Fischer responds 
as Black on the fourth board, she copies this to the last board against Spassky, and if Fischer opens 
as White on the third board, she copies this to open the other board against Spassky. 

On the left two boards she "plays Fischer against himself". If Fischer opens with White on the 
second board, she copies this to him on the first board; if Fischer responds as Black on the first 
board, she copies that back to the second board. This corresponds to the first argument Ax'^.x of 
Hg^g in the term 

Ah^.AG.Ag'^.hG^G (Ax'^.x) g 

associated with this strategy. 

Note that all three of the above copycat strategies are uniform: had the imported game been 
O's & X's instead of Chess, Anna-Louise would have copied the moves around in exactly the same 
geometry. In the third strategy she would have imported O's & X's O's & X's for Gi against 
Fischer This strategy always imports K ^ K against Fischer, whatever the game K imported by 
Spassky. The geometry of Anna-Louise's six copycat links is independent of K. 

1.5 Other conceptual ingredients of the model 

This subsection may be somewhat abstruse for readers not already familiar with game semantics; 
consider skipping to Section^below, without loss of continuity. 

So far in this introduction we have sketched the following ingredients of our model: 

• Hj^ergames: games as moves, to model universal quantification/instantiation. 

• Self-reference: hypergames can be imported into hypergames, and a hypergame may even be 
imported into itself. 

• Uniformity: the shape of Anna-Louise's play, in terms of how we copy moves around, cannot 
depend on the choices of games imported by the opposing team: she must treat those games 
as "black boxes". Once two (sub) games are linked by copycat, she cannot change that link. 

The following additional ingredients come from prior (first-order, unquantified) work: 

• Backtracking. We permit moves to be taken back during play, corresponding to the fact that a 
system F function can call its argument an arbitrary number of times. Backtracking was used 
by Lorenzen l1Lor601 fFelSSl for modelling proofs of intuitionistic logic, by Coquand ||Coq9l} 
|Coq95P , and by Hyland and Ong HHOOOII . 
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• Innocence. Following Coquand [ |Coq91| [Coq95| |, Hyland-Ong HHOOOH and Nickau ||Nic96| . 
strategies depend only on a restricted "view" of the history of play. 



• Interaction. We use Coquand-style interaction between backtracking strategies to model nor- 
malisation of system F terms, specifically, the refinement by Hyland and Ong of this interaction 
in a lambda calculus (cartesian closed) setting. 

• Liveness. A strategy must always be able to make a move (coined liveness by Conway llCon76|| ). 

• Copycat condition. We impose (a restriction of) Lorenzen's condition ||Lor60ll for dialogues 
listed by Felscher as (DIO) ||Fel85|| . which requires that an atomic formula (or in the present 
system F context, a t5^e variable) be "asserted" by Anna-Louise only if, within her view, the 
opposing team has just asserted itP^ 

These additional ingredients relate to quantifiers: 

• Copycat expansion. Technically, uniformity will be implemented by copycat expansion [ |Hug06[ | , 
similar to Felscher's skeleton expansion jPelSSl iFelOlU (and equivalent to the condition in 
| |Hug97[ [HugOO[ | ) : whenever a strategy includes a play (accepts a move sequence) p, with a 
variable X imported by the opponent into a quantified variable, then for all types T, all vari- 
ants of p obtained by substituting T for X and playing copycat between appropriate instances 
of T are also in the strategy!^ 

• Compactness. A strategy is determined by a finite "skeleton", which expresses only the copycat 
links between components. 

The main theorem is that the map from system F terms to strategies (satisfying the above properties) 
is surjective. A surjectivity theorem of this kind for simply typed A-calculus is given in [PI08O], but 
since [AJ92] such a result in a logical setting has often come to be referred to as full completeness, 
when it includes a semantic notion of composition. 

1.5.1 Modular construction of games 

We shall define system F games modularly. First we define a transition system whose states are 
system F types, and whose transition labels are hj^ermoves. The hypermoves involve instantiating 
quantifiers in the states (just as the examples above involved instantiating quantifiers during play) . 

Every transition system determines a forest (disjoint union of trees) : its set of non-empty traces. 
Every forest can be interpreted as an arena, in the sense of Hyland and Ong HHOOOH . 

Following Hyland and Ong, every arena defines a game, with backtracking. The (hyper) game 
we associate with a system F t5^e will be such a backtracking arena-game. Since we use arena 
games, interaction of strategies (composition) is precisely the Hyland-Ong interaction. 

The underlying first-order composition allows us to relate the composition to an underlying 
untyped lambda calculus machine, as in ||DHR96| , upon erasing the system F type information. 
In other words, the composition, when viewed as acting on r|-long |3 -normal forms (representing 
innocent view functions), corresponds to (a) erasing the system F type information, (b) computing 
with the abstract machine [|DHR96,1 on the underlying untyped lambda term, then (c) replacing 

^^I was unaware of Lorenzen's (DIO) at the time I wrote (Hug97| [HugOO|| . 

^^I was unaware of Felscher's skeleton expansion at the time I wrote | |Hug97| [HugOO) . 
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type information 13 If we erase the type information but stay in the model (i.e., we don't look at the 
lambda terms), then we are just composing strategies in a naive games model of untyped lambda 
calculus. The underlying transition system of the untj^ed lambda game has a single state and 
every integer i > 1 as transition labels. These integer labels are precisely the result of deleting the 
instatiating types from the transition labels of the system F transition graph. Or to put it another 
way: the system F transition labels are those of the untyped lambda transition graph together with 
type instantiations. The untyped lambda calculus games similar to those in [KNO02J. 

1.6 Related work 

Affine linear polymorphism was modelled in rAbr970 with a PER-like "intersections" of first-order 
games of the form ||AJ94[ lAJMOO.l . Abramsky and Lenisa have explored systematic ways of mod- 
elling quantifiers so that, in the limited case in which all quantifiers are outermost (so in particular 
positive), models are fully complete HALOOl . (See subsection 11.41 for a simple example of a type at 
which full completeness fails.) 

The hypergame/uniformity technique presented here has been applied to affline linear logic 
HMOOlllMurOlH . and has been used to study Curry-style type isomorphisms idL06i . 

2 Transition system games and backtracking 

A game such as Chess or O's & X's has a state (the configuration of the board or grid) and, for every 
state, a set of transitions or moves (e.g. -^^fS, Ab4, X top-right, O centre), each with an ensuing 
stately Such a game can be specified as a deterministic labelled transition system: an edge-labelled 
directed graph whose vertices are the states of the game, with a distinguished initial state. A 
fragment of the transition system for chess is illustrated belowP^ 

^■'l have a vague recollection that just such an abstract machine was analysed for system F in the masters' thesis of Hike 
Ritter. I need to investigate this. 

^^Samson Abramsky's course at this summer school, during the summer before my D.Phil., is in part what inspired my 
choice of thesis topic. 

^^For a game of chance such as backgammon, one would specify a probability distribution over ensuing states, rather than 
a single ensuing state. We consider only deterministic games here. 

^^The states include data for en passant and castling and rights, and the turn (Black or White to move), not shown in the 
diagram. 
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Note that the graph is not a tree. Without a distinguished initial state, we shall refer to such a graph 
as a transition graph. 

Formally, a transition graph (Q, M, -> ) comprises a set Q of states, a set L of labels, and a 
partial transition function -> : Q x L ^ We write q q' for ^ (q, I) = q'. A transition 
system (Q, L, -> is a transition graph (Q, L, ->) together with an initial state ★ e Q. A trace of 
(Q, L, -> ,*) is a finite sequence li . . . 1^ of labels U e L (k ^ 0] such that 



k U 
* ^ qi ^ q2 — 



— >■ qk-1 — 



qk 



for states qt G Q (1 < i ^ k)lll For example, d4 €^f6 c4 is a trace of chess, visible in the diagram 
above. 



2.1 Games 

Let M be a set of moves. A trace over M or M-trace is a list (finite sequence) mi . . . mk of moves 
mi e M (k ^ 0) . A set G of M-traces is a tree if whenever mi . . . mk is in G with k ^ 1 then 
its predecessor mi . . . mk-i is also in G, and the empty trace e is in G (the root of the tree). A 
game over M or M-game is a tree of M-traces. Following [HOOO], we write O for the first player 
(associated with odd moves, i.e., moves in a trace with odd index), and P for the second player 
(associated with even moves) . 

i^We write f : X ^ Y if f is a partial function from X to Y, i.e., a function X' ^ Y for some X' C X. 

^^Note that the states G Q are uniquely determined by the l^, since our transition systems are implicitly deterministic. 
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Every transition system A with label set M defines a game G(A) over M, namely the set of traces 
of A. For example, if A^^ is the chess transition system depicted above, and Mq^ is the set of all 
chess moves {^e5, Wa2, '^hl, . . .}, then G{Ac^) (the set of all traces of the chess transition system) 
is a game over Mq^. This game comprises all legal sequences of chess moves. 



2.2 Strategies 

A strategy (implicitly for the second player P) for a game G is a tree ff C G whose every odd-length 
trace has a unique one-move extension in cr: if rai . . . mk e cr and k is odd, there exists a unique 
move ra such that mi . . . raicm e cr. A strategy cr for G is live (or total) if it responds to every 
stimulus: if mi . . . raic G cr with k even and rai . . . m^m G G, then mi . . . m^m G crP^ 



2.3 Backtracking 

When playing chess against a computer, there is usually an option to take a move back. If we allow 
both players (user and computer) to take back moves, and also to return to previously abandoned 
lines, we obtain a derived game in which a move is either an opening chess move (starting or 
restarting the game) or is a pair: a pointer to an earlier move by the opponent, and a chess move 
in response to that move. For example, here is a trace of backtracking chess, with time running 
left-to-right (so backtracking pointers are right-to-left) : 




The penultimate move e3, with no backtracking pointer, is a restarting move. Since this is a trace of 
a game with an underlying transition system, we can include the states in the depiction, as below, 
which corresponds to the first six moves above. 
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In this depiction we draw the pointers akin to transitions in the underlying transition system, with 
their labels. This clarifies the sense in which we refer back to a previous state during backtracking, 
and make our move from there. 

We shall write G for the backtracking variant of a game G, formalised below. Let M be a set of 
moves. A dialogue over M is a an M-trace in which each element may carry an odd length pointer 



^'Thus mi . . . m]<mn G cr for a unique n, the "response of a to m. after mi . . . mi<". One is also tempted to call such a 
strategy total, by analogy with partial versus total functions; we shall stick with Conway's original terminology tCon76il . 
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to an earlier element (c/ IILor60[ lFel85[ |Coq9 1 1 |Coq95| IHOOOH ) . For example, a dialogue over the 
set Mq^ of chess moves is depicted above. Formally, a dialogue over M is an (N x MVtracj^ 

(ai,rai) . . . (ak,Taic) 

such that i — at G {1, 3, 5, . . .} for 1 ^ i ^ k. Each at represents a pointer from mi back to ma^, 
with ai — coding "mi has no pointer". The formalisation of the chess dialogue depicted above is 
the following (Nx M(a)-trace: 

(0, e4) (1, e5) (2, ^f3) (1, c5) (2, f4) (3, ^c6) (6, Ab5) (3, ^f6) (0, e3) (7, q6) 

A move of the form (0, m), without a pointer, is a starting move. A thread of a dialogue over M is 
any sequence of elements traversed from a starting move by following pointers towards the right. 
For example, e4 e5 ^f3 ^c6 Ab5 is a thread of the chess dialogue above: 




The singleton sequence e3 is also a thread, as is e4 e5 f4 . Formally, an M-trace radi • • • ^^T-dn (where 
n ^ 0) is a thread of the dialogue (ai,mi} • • • (ak, rak) over M if — and — dj_i for 
1 < i ^ n. 

Let G be an M-game. A dialogue over M respects G if its threads are in G. For example, if Chess 
abbreviates our earlier formalisation G{Ai^) of the game of chess as a transition system game, then 
the dialogue over M^^ depicted above respects Chess (since every thread is a legal sequence of 
chess moves from the initial chess position). The backtracking game G is the set of all dialogues 
over M which respect G. For example, the dialogue over Mchess depicted above is a trace of Chess, 
i.e., of "backtracking chess". 

The P -backtracking game G^ is obtained from G by permitting only the second player P to 
backtrack: every 0-move (move in odd position) but the first points to the previous move. Formally, 
G^ comprises every (ai, mi) . . . (ak, TUk) in G such that ai = i — 1 for all odd i e {1, . . . , k}. A 

dialogue of Chess is shown below. 




For every type T of system F, we shall define a transition system Aj and define the hj^ergame 
associated with T simply as the backtracking game over this transition system, i.e., G(At). For 
didactic purposes, we begin in the next section with the restricted case of lambda calculus. 



3 Lambda calculus games 

Let A denote the types of A calculus generated from a single base type X by implication Every A 
type T determines a transition system Ay : 

= {0,1,2,...}. 
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• States are A types, with an additional initial state ★ . 

• A label is any i e {1, 2,3,.. .}, called a branch choice. 

• Transitions. A 1 -labelled transition 

* ^ T 

from the initial state to T, and transitions 

Ti ^ T2 ^ . . . ^ ^ X ^ Tt 

for 1 ^ j < n. 

For example, if U — X ^ (X ^ X) ^ X then the reachable portion of the transition system Au is 

1 

X (X ^ X) ^ X 

/ X 

X < 1 X ^ X 

so the associated (non-backtracking) game (set of traces) G(Au) is {e, 1, 11, 12, 121}, where e de- 
notes the empty sequence. 

Theorem 1 Let J be a lambda calculus type generated from a single base type X by implication 
The ri -expanded |3 -normaJ terms of type T are in bijection with finite live strategies on the 

P -backtracking game G ( Ay ) . 

Proof. A routine induction: a restriction of the definability proof in ]Hug97| , in turn a variant of 
the definability proof in HHOOOH . □ 

The Tj-expanded (3-normal forms of U — X ^ (X ^ X) ^ X (whose transition system was 
depicted above) ar^ 

for n ^ and the unique maximal trace of the corresponding live finite strategy t^, on G(At] is 




with n occurrences of 2. Below we depict this dialogue in the case n — 2 (corresponding to the 
term Ax^ . Af''^"*-'^ . f(f x)) with its states (as we did for the chess dialogue on page 121 D . It is easier 
to display with time running down the page, rather than from right to left. 



21 f" denotes n applications of f : f°{x] = x and f^lx) = f (f""i(x) ) for n ^ 1. 
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■k 

X ^ (X ^ X) ^ X 




X 



This notation highlights the similarity with Lorenzen's dialogues llLor60[ iFelSSH . What we show as 
states, he referred to as assertions. 

3.1 The copycat condition 

In this section we introduce the copycat condition ['Hug97'| on strategies, which is crucial for 
uniformity (more precisely, for us to be able to implement uniformity via copycat expansion later). 
This condition a slight restriction of a condition of Lorenzen for dialogue games (listed as condition 
(DIO) in HFelSSH "). We shall introduce the condition in the context of lambda calculus games; the 
generalisation to system F games in the sequel is immediate. 

Extend the set X of lambda calculus tj^^es from the previous subsection to those generated 
by implication from the ambient set Var of system F type variables. The transition system Aj 
associated with a A type T is defined exactly as in the previous section, but now in the transitions 

Ti ^ T2 ^ . . . ^ T^ ^ X Ti 

X may be any type variable in Var. 
The colour of a transition 

Ti ^ . . . ^ Tn ^ X Ui ^ . . . ^ Un, Y 

(where necessarily Ti = Ui ^ . . . ^ 11^, Y) is the rightmost variable Y in the target. The colour 
of a move in a trace of G(At) or a dialogue in G(At) is the colour of the associated transition. A 
dialogue in the P-backtracking game G(Ax) satisfies the copycat condition if the colour of every 
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P-move (even-index move) is equal to the colour of the preceding 0-movel^ A strategy satisfies 
the copycat condition if each of its traces satisfies the copycat condition. 
As a simple illustration of the copycat condition, consider the type 

U = Y^X 

whose transition system Au is belov^f (only reachable states shown). 




X Y 



The colour of the top and lower-left transitions is X, and the colour of the lower-right transition is 
Y. The associated (non-backtracking) game (set of traces) G(Au) is {e, 1,2, 11, 12}. There are two 

live strategies in the P-backtracking game G(Au) , whose maximal traces are as follows, with the 
colour of each move shown beneath it in brackets: 

1'- ""1 I'' ""2 

(X) (X) (X) (Y) 

The first strategy satisfies the copycat condition, while the second does not. The strategies corre- 
spond (respectively) to the terms 

of which only the former is typed correctly as X ^ Y ^ X. The second attempts to return y of type 
Y, while the rightmost variable of X ^ Y — > X is X. This corresponds to the failure of the copycat 
condition for the second strategy. 

The following is a corollary of the theorem above. 

Theorem 2 Let J be a lambda calculus type generated from the set Var of system F type variables by 
implication The r\-expanded ^-normal terms of type T are in bijection with finite live strategies 

on the P-backtracking game G ( Aj ) which satisfy the copycat condition. 
3.2 Remarks on Hyland-Ong arenas 

This section is for readers familiar with Hyland-Ong games l\HO00]l . It can be skipped without loss of 
continuity. 

The set of non-empty traces of a transition system forms a forest under the prefix order, and 
is therefore an arena in the sense of Hyland and Ong [HOOO]. Write A (A) for the arena of a 

^^Lorenzen's condition (DIO) required the colour to be equal to any prior 0-move in a P-backtracking trace. 
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transition system A, and for a lambda calculus type T abbreviate A(A(T)) to A(T). The following 
arena isomorphism is immediate: 

A(T^U) = A(T)^A(U) 

where ^ is the Hyland-Ong function space operation on arenas and = is isomorphism of forests. 

Elements of these arenas are sequences (traces), and therefore Hyland-Ong dialogues in them 
suffer some redundancy, as in (for example) 




a ab abc ab' abc' abed abcde abed' 




in the arena generated by a transition system with transition labels a, b, b', c, c', d, d', whose traces 
include abode, abed', abc', etc. Clearly, one can abbreviate this trace to 




eliminating the redundancy. This is how we have opted to formalise the backtracking games over 
transition systems in the previous subsections. Note, however, this notational difference is trivial, 
and in spirit they are essentially Hyland-Ong arena/dialogue games. The notation is simply taylored 
towards arenas whose forests are described as sets of traces, rather than partial-order forests as used 
originally by Hyland and Ong I HOOOH . Since our games are Hyland-Ong games, and we have the 
isomorphism relating syntactic with arena =^ above, we obtain composition (hence a category) 
as standard Hyland-Ong composition of innocent strategies. 

In the next section we extend the lambda calculus transition systems to system F transition 
systems. The following arena (forest) ismorphisms will then hold: 

A(T-^U) = A(T)=»A(U) 
A(VX.T) = nTypesuA(T[U/X]) 

The arena-product Yl (disjoint union of forests) is taken over all system F tj^es. Composition in 
our system F model is simply Hyland-Ong composition. 

4 System F games (hj^ergames) 

We extend the lambda calculus transition systems defined above to all of system F. States will be 
types, as before, and a transition will remain a branch choice i ^ 1, but now together with some 
types to instantiate quantifiers. We begin by precisely defining quantifier instantiation. 

Recall that a prenex type is a type in which all quantifiers have been pulled to the front by 
exhaustively applying the rewrite 

T ^ VX.U VX . T U 
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throughout the typejf^ Thus a type is prenex if and only if it has the form 

VXi .VX2 . ■ • • VXm. . Ti ^ T2 ^ . . . ^ Tn ^ X 

for prenex types Ti and type variables X and Xj . Write T[V/X] for the result of substituting the type 
V for the free variable X throughout the prenex type T, and (if necessary) converting to prenex 
form. For example 

(X ^ X)[VY.Y/X] = VY. (VY'.Y') ^ Y 

via: 

(X^X)[VY.Y/X] (VY.Y) ^ (VY.Y) VY.(VY'.Y') ^ Y. 

Define 

VX.T • V = T[V/X] 
called the result of importing V into VX.T. For example, 

VX.X^X-VY.Y = VY. (VY'.Y') ^ Y. 

Write T • V1V2 . . . Vn for the iterated importation (. . . ((T • Vi) • V2) • . • .) • Vn, when defined. For 
example, 

VX . X ^ X • (VY.Y) (Z ^ Z) = (VY.Y) ^ Z ^ Z . 
A prenex type is resolved if it has no outermost quantifier, i.e., it has the form 

Ti^T2^...^Tn^X, 

a form which we shall often abbreviate to 

TiT2...Tn ^ X 

Each Ti, is called a branch. If T • Ui . . . is resolved, we say that Ui . . . lin resolves T to T • Ui . . . U 
For example, we saw above that (VY.Y) (Z Z) resolves VX . X ^ X to (VY.Y) Z ^ Z. 
Define the transition system Ay of a prenex type T as follows: 

• States are resolved prenex tj^es, with an additional initial state * 

• A label is a pair (i, Vi . . . Vk) where i ^ 1 is a branch choice, k ^ and each Vi is a type, 
called an import. 

• Transitions. A 1 -labelled transition 

* -U T 

from the initial state to T, and transitions 

TiT2...T^^X ^^'^Lll^^'^^ UiU2...U^^Y 
whenever 1 < i < n and 

Tt.Vi...Vk = UiU2...U„,^Y 

(Thus a transition chooses a branch Ti and resolves it to form the next state.) 

^^Without loss of generality, in the rewrite assume X is not free in T. 

^^Prenex types were drawn graphically in | |Hug97| |HugOO| |, in a manner akin to Bohm trees, and called polymorphic 
arenas. 
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More generally, the transition system of a tj^e is the transition system of its prenex form. 
An example transition is shown below. 

(X' ^ X' ^ X') ^ (VX.X ^ X) ^ X" (^Y.Y)(Z^Z2^Z)) ^^^^^ ^ Zi ^ Z2 ^ Z 

The branch choice 2 selects the branch VX.X — > X and the imports VY.Y and Zi — > Z2 ^ Z resolve 
this branch to form the next state 

4.1 Implicit prenexification 

Prenexification is a lynchpin of the hj^ergames approach ['Hug971 : it is critical to the dynamics of 
hypergames that in a tj^e T VX.U the quantifier VX is available for instantiation. Whether we 
make the prenexifications T VX.U ^ VX.T U explicit during play or not is optional. We can 
just as well leave prenexification implicit, by formally designating VX as available for instantiation 
in T ^ VX.U . 

A quantifier VX in a type T is available if T has any of the following forms @ 

• T = VX.U 

• T = U ^ T' and VX is available in T' 

. T = VY.T' and VX is available in T'. 

For example, VX and VY are available in VY.{VZ.Y ^ Z) ^ VX.X, but VZ is notl3 

Type resolution and importation are tweaked in the obvious way, as follows. A type is resolved 
if it has no available quantifier, i.e., if it has the form 

Ti^T2^...^Tn^X = Ti...Tn^X 

for n ^ and tj^es T^, called branches. (All we have done is drop the requirement that the be 
prenex.) Let VX be the leftmost available quantifier in a type T, and let T'^ be the result of deleting 
VX from T (e.g. if T = U VX.V then T^ = U V). Define 

T . V = T^[V/X], 

the result of importing a type V into T, and define iterated importation T • Vi . . . Vn as before. 
The (lazy style) transition system Ay of a system F type remains essentially unchanged: 

• States are system F types, with an additional initial state ★ . 

• A label is a pair (i, Vi . . . V^) where i ^ 1 is a branch choice, k ^ and each Vt is a type, 
called an import. 

^^To obtain a category with products, we extend system F with products, and allow import/resolution/substition with 
products. 

26^g assume without loss of generality throughout this section that all bound variables are distinct from one another and 
from the free variables. 

^^Note that VX is available in T iff it is one of the outermost quantifiers in the prenex form T of T (i.e., T = 
VXi . . . VX]^.U and X is among the Xt). In this sense, prenexification is implicit, or "lazy": from a behavioural point 
of view, we're still working with prenex types. 
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• Transitions. A 1-labelled transition 



from the initial state to T, and transitions 

TiT2...T^^X ^^'^Li:^^'^^ UiU2...U^^Y 
whenever 1 < i < n and 

Tt.Vi...V„ = UiU2...U„,^Y 

5 Black box characterisation of system F terms 

A black box importation is an importation of the form 

VX.T • X = T, 

simply deleting the quantifier. Thus the bound variable X becomes free. We refer to X as a black 
box. (We continue to assume, without loss of generality, that within a type all bound variables are 
distinct from one another and from all free variables.) Let T be a closeco system F type and d a 

dialogue in the P-backtracking game G(At) . The first player O imports black boxes in d if every 
importation associated with O in d is a black box importation, and the second player P respects 
black boxes in d if every import associated with P takes its free variables among the black boxes 
imported hitherto by O. A dialogue in which O imports black boxes and P respects them is a black 

box dialogue. The black box game G(At) is the restriction of the P-backtracking game G(At) to 
black box dialogues. 

The copycat condition extends from the lambda calculus case to system F in the obvious way: 
the colour of a transition is once again the rightmost variable of the target. 

Theorem 3 Ther\-expanded ^-normal terms of a closed system F type T are in bijection with finite 

- — - — - B 

live strategies on the black box game G [Aj] which satisfy the copycat condition. 



Proof. The definability proof in pug97P . □ 



6 Uniformity by copycat expansion 

The black box game is highly unsymmetric: 

(1) P can backtrack, while O cannot. 

(2) P is subject to the copycat condition, while O is not. 

(3) O can only import black boxes (free variables); P can import arbitrary types, so long as their 
free variables are prior black boxes. 



^No free variables. 
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To compose strategies we must symmetrise the game, so that O and P can interact. 

A symmetrisation of backtracking (1) was obtained by Coquand | |Coq91| [Coq95[ . A shared 
history of two asymmetric strategies is buih, in which both players backtrack. Each time either 
asymmetric strategy plays a move, it can only see a projection of the shared history in which the 
opposing player does not backtrack. This interaction was made lambda-calculus specific by Hyland- 
Ong llHOOOL who called the projections views and called the symmetrised strategies innocent. 

Symmetrising the copycat condition (2) will be automatic, coming as a simple side effect of 
the views: we simply demand that, in their respective views, both strategies adhere to the copycat 
condition. 

We shall symmetrise with respect to black boxes (3) via the notion of copycat expansion [ |Hug06p 
recalled belowEB 

Symmetrising (1) yields interaction for lambda calculus over a single base type symbol. Sym- 
metrising (1) & (2) yields interaction for lambda calculus over a set of base type symbols. Sym- 
metrising (1) — (3) yields interaction for system F. 



Symmetrising 


yields interaction for 


(1) 


A, single base type 


(1) & (2) 


A, set of base tj^es 


(1) & (2) & (3) 


system F 



We shall refer to the copycat condition together with copycat expansion as uniformity. A visual 
summary of the symmetrisation is below, where T is a system F type. 

B uniformity p innocence 

G(At) >G(At) >G(At) 

An arrow here indicates how a strategy on the left lifts to a strategy on the right. 
6. 1 Symmetrising black boxes via copycat expansion 

Let T be a closed system F tj^e and d a dialogue in the P-backtracking game G (Aj) which satisfies 
the copycat condition. Let X be a black box in d, let U be a type, and define d[U/X] as the result of 
substituting U for free occurrences of X in the imports of d. 



To be continued. . . 
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